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Afertracti. We have developed an imaging system for high speed image acquisition in 
fluorescence microscopy. The use of a two- dimensional CCD array in a special 
operation mode called TDI (Tims Delayed Integration) permits a significant increase in 
photon integration time compared to ID scanners (higher signal-to-noise ratio) without 
compromising the total data throughput rate. Instead of a staxt^stop system we use 
continuous stage motion in the CCDs parallel shift direction. Synchronizing the parallel 
dock and the stage velocity guarantees a one-to-one relationship between a moving cell 
and its image onto the CCD. Compared to start-stop systems, TDI Maiming offers a 
speed improvement, negligible blurring in the scanning direction and a complete 
suppression of pixel variability boosting the SNR more than 10 dB. 

ESeywoirfc TDI, signal-to-noise ratio, fluorescence microscopy, CCD camera, spatial 
frequency response. 



Image cytometry— while it offers the opportunity for 
accurate and precise measurement of cell properties as 
well as confirmation of detection — has been limited to 
small sample sizes. In a number of important areas the 
need for instrumentation for high-speed measurement of 
cells and cellular constituents has outstripped available 
systems. In modern molecular cytogenetics, techniques 
have been developed to selectively label various DNA 
sequences with fluorescence tags in interphase as well as 
metaphase cells. This technique is called fluorescence 
in situ hybridization (FISH) (Carte? 1994). FISH makes 
it possible to detect structural chromosomal abnormalities 
in metaphase spreads. Structural abnormalities include 
translocations, amplifications and deletions. FISH also 
allows large scale screening to detect an abnormal copy 
number of a specific chromosome in interphase cells. In 
order to obtain a reliable estimate for the frequency of 
occurrence a large number of cells needs to be analysed 
(NetteneroM$$4). 
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A bottleneck in fluorescence image cytometry is the low 
intensity of fluorescendy labeled probes. Often intensified 
CCD cameras are used to deal with low light levels. But 
such systems do not have the proper characteristics, because 
the intensifier causes a boost of the photon shot noise 
and reduces the spatial resolution. Low intensities require 
special cameras that are capable of accumulating signals, 
for tens of seconds. A slow-scan cooled CCD camera has 
the required characteristics. Such a camera offers a linear 
photometric response over a large intensity range, cooling 
that effectively suppresses me dark current to allow long 
integration times and a slow readout rate to provide a low 
seadout noise. 

Traditionally, automated systems capture images field 
after field. Image acquisition (exposure and readout) and 
stage movement from one field to the nest field takes place 
during the processing time of the previous image. The stage 
movement starts directly after the exposure, during readout 
Using a slow-scan CCD camera the stage motion will be 
finished before the readout is completed. Real-time amage 
processing can be achieved when the processing time is 
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shorter then the total time seeded for image Requisition and 
stage movement Throughout this paps? this field approach 
will he referred to as static image cytometry. In dynamic 
image cytometry there is a continuous Sow of data that is 
processed and analysed in real-toe. As a consequence, the 
microscope stage moves non-stop to offer new scenes at the 
input of the system. Dynamic imaging systems have been 
developed for bright field microscopy (Stark et a! 1989, 
Tucker et al 1987) . These imagers make use of a one- 
dimensional linear CCD and are not suitable for low light 
intensities. The data throughput will be very low for long 
integration times. Using a two-dimensional CCD combined 
with time-delayed-integration a high data throughput is 
possible without compromising the integration time. 

A number of time-delayed-integration imagers have 
been reported in the literature (Schlig 1986). These 
scanners are designed to be used for page and document 
imaging. Special TDI CCD sensors are used to achieve 
high speed and signal-to-noise ratio even with low light 
levels (Barbs 1976). The TDI sensors are characterized by 
the width of the array (serial dimension) and the number 
of stages (parallel dimension). Typical example of such 
an array is 2048 x 96 TDI chip. Signal level increases as 
the number of TDI stage increases whereas the total noise 
level increases by the square root of the number of stages 
(Chamberlain and Washkurak 1990). 

We have designed a TDI scanner suitable for fluorescent 
image cytometry. It is built around a slow-scan cooled CCD 
camera that is normally used for static imaging. This paper 
presents the design and performance of such a system* The 
paper is organized as follows. In section 2 we describe 
the principle of TDI scanning. Section 3 gives a summary 
of the design parameters. The actual implementation is 
presented in section 4. We have evaluated the scanner by 
measuring the SNR, spatial frequency response and speed. 
The experimental results are given in section 5. Finally, in 
section 6 we draw some conclusions. 
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A CCD element consists of a two-dimensional matrix of 
square photosensitive sites, the electron wells. This matrix 
is called the parallel register. The CCD contains a second 
register, the serial register, which is itself a one-dimensional 
CCD and plays an important role during CCD readout. 
In the operation of a full frame CCD we distinguish two 
stages: the integration time in which the exposure takes 
place, and the readout time. When sufficient photon- 
induced electrons have been collected in the various CCD 
wells, the CCD is ready for readout During the readout 
time all charge stored in the parallel register is shifted (in 
parallel) towards the serial register. Each cycle the parallel 
clock causes a shift of exactly one row. The charge stored 
in the top pixel row is shifted from the parallel register into 
the serial register. Once in the serial register, the serial 
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or pixel clock transfers the charge packets to the amp»fi«f*r 
and A/D converter. After the serial register is emptied the 
whole cycle of a parallel shift followed by serial readout is 
repeated until the parallel register is emptied (Aikeas etui 
1990). 

TDI scanning combines the light integration* with the 
CCD readout into a continuous process. During integration 
the continuous movement of the stage is synchronised with 
the parallel shift of die CCD. At each parallel clock cycle 
a new row of pixels at the bottom of the CCD is exposed 
by a new scene. As the scene moves, the corresponding 
row also shifts in the same direction at each cycle of the 
parallel clock. Finally this row reaches the top of the CCD 
and is shifted into the serial register and then to the A/D 
converter. Figure 1 shows three steps of TDI Manuring 
Considering the black pixel in the left-most column, the 
pixel shifts towards the serial register synchronized with 
the motorized stage. The pixel integrates from the bottom 
of the CCD until it reaches the serial register. TDI 
scanning permits continuous movement of She stage (high 
throughput) without compromising the photon integration 
time (high SNR). This leads to a continuous pixel stream 
during the integration. The result is an image of 5 x N 
pixels, where S is the serial dimension of the CCD and N 
can be extremely long. 
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lb avoid unnecessary blurring, both the scanning speed 
and the scanning direction need to be controlled. TDI 
scanning requires precise alignment between the parallel 
shift direction of the CCD and the direction of stage 
movement. The integration time can be controlled by 
adjusting the stage velocity and shift frequency. The values 
for the parallel clock and the stage velocity depend on 
the camera and the microscope setup. For a required 
total integration time T\ (that is dependent upon specimen 
brightness), the parallel shift frequency / p is given by: 



P 

/p^™ (Hz) 



(1) 



where P is the parallel dimension of the CCD chip. With 
a frequency / p a row of pixels shifts from the bottom to 
the top of the CCD in T\ seconds. As the CCD shifts one 
pixel the stage must move one pixel distance divided by 
the magnification. The stage velocity is given by: 



TiM / 0 



(jim s" 1 ) 



(2) 



where M is the total magnification, D is the pixel size 
and f a is the spatial sampling frequency of the microscope 
system. The spatial sampling frequency can be measured 
with a bar pattern on a test slide. Using a zoom 
projection lens, each time the magnification changes the 
sampling frequency must be measured, tthesefbre a fixed 
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Figure 1. Three stages of TDI scanning at intervals separated by 4 cycles of the parallel clock. The numbered black dots 
are moving upwards and are imaged on a CCD matrix. 



magnification is to be preferred. In our system there is no 
position feedback from the stage to control the camera shift 
Therefore the stage velocity as well as the shift frequency 
must be very stable and accurate. 

The maximum readout rale (run) of the camera limits 
the shift frequency and stage velocity. Given equation (1), 
the upper bound of the shift frequency is given by: 



scanning speed: 



r mta 



(Hz) 



(3) 



where S is the serial dimension of the CCD. Due to the 
upper bound of the shift frequency the integration time is 
limited by a lower bound and is given by: 



H>r r . 



(s) 



(4) 



T T is the readout-time of wexam^ a full image. 

A shorter integration time then the readout time is not 
possible with TDI scanning. If a shorter integration time 
is required due to saturation of CCD wells, the emitted 
light must be reduced. An optical neutral density filter is 
a common way to reduce the photon flux but, in practice, 
strong FISH signals are extremely rare. 

The scanning speed is defined as the total area that 
is scanned per second; Each second S times f p pixels 
are acquired. The number of pixels divided by the spatial 
sampling density squared gives the area that is scanned per 
second. Combining this result and equation (1) yields the 



PS 



(5) 



Equation (5) shows that the scanning speed is detenriined 
by the required integration time, sampling density and the 
dimension of the selected CCD. Because of the limitation of 
the readout rate the maximum scanning speed is achieved 
when the integration time is equal to the readout time of 
the camera. Typical values for all of these variables will 
be presented in the following section. 

4. System Implementation 
4,1. Hardware 

Our TDI scanning system is built around a Nikon Diaphot 
epi-illiirninatfri inverted microscope. The microscope is 
fully automated. Focus, stage, camera and excitation 
shutter are controlled by a computer. Figure 2 shows a 
schematic diagram of die system. 

The microscope is equipped with a motorized stage. 
The stage is driven by two DC motors. Each motor has 
a position encoder that is part of a closed loop system, 
controlled by a digital Proportional Integral Derivative filter 
(FID, model LM 628, National Semiconductors) (Warwick 
and Rees 1988). One encoder step size is 50 nm. TDI 
scanning requires a constant velocity of the stage. Our 
experiments have shown mat stepping motors are not 
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Figure 2. Schematic overview of a TDI scanning system. The dashed lines separate the camera, microscope and control 
unit 



suitable for this application. With DC motors the stage 
velocity is more stable. The FID filter cannot compensate 
for mechanical disturbance of the stage because the stage 
is not included in the close loop. The encoder gives die 
position of the motor and not of die stage. Therefor precise 
mechanics is used to connect the motors and the stage. 
Focus control is also driven by a DC motor with a FID 
filter. Here the encoder step size is 25 nm. 

A rotation head between camera and microscope is used 
to align the direction of camera shift and stage motion. 
The zoom lens can be used to adjust die magnification but 



has the disadvantage that the sampling density has to be 
measured each time. 

A Photometries 200 series camera (Aikens et al 1990) 
is connected to die microscope. This is a slow-scan 
cooled CCD camera. A Peltier element cools the CCD 
below -35°C to suppress dark current The readout rate 
is 500 kHz which is slow compared to the 15 MHz of 
a video camera. An A/D unit converts the collected 
charge in 12 bits data. The noise level of this camera 
is photon limited. This means that all other noise sources 
of the camera are negligible in comparison to die Poisson- 
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Kodak 



Type 

Element size (5 x P) 
Pixel size 
Averse (gain* 1 ) 
Maximum SNR 
Operating temperature 



TH7882 
384 x 576 
23 x 23/i m 
90.9 e-»/ADU 
56 dB 
-35°C 



KAF14Q0 
1317 x 1035 

6.8 x 6.8 /t m 

7.9 e-VADU 
45 dB 
-42°C 



Focus samples for linear fit 
Measured focus position 
QPocus position - Focus Flti 




Mgssre 3. The measured focus position and the result of & linear 
fit with three focusing samples of a strip of 3.2 mm. The bulbs 
are the absolute difference between the measured focus position 
and the linear fit z = 8.64 - 2.57*. Crossed squares: focus 
samples for linear fit; diamonds: measured focus position; 
circles: jfocuspositioa - focusfitf. 



distributed photon noise. Photometries provides different 
CCD elements for the series 200 camera. We have used two 
cameras with different elements, the Thompson TH 7882 
chip and the Kodak KAF14C0 chip. Each chip has its own 
characteristics. Hie Kodak chip is very large (1.3 Mpixels) 
and has small pixels. The Thompson chip is comparable 
to the format of a CCD video camera. The specifications 
are listed in table 1. The camera control provides the 
commands for lime Delayed Integration. The external 
trigger of the camera synchronizes the parallel shift with 
the stage motion. The camera control can contain between 
4 to 32 MByte memory. The data are temporarily stored 
in the camera control memory, to await further processing. 
Camera, stage and focus control are connected to a Sun 
4/260 computer with an external VMB bus. 
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TDI scanning is particularly interesting when large areas 
have to be scanned. The scanning area is divided into 
strips. The TDI system images each strip in one scan. Due 
to the parallel shift of the CCD array there is only one scan 
direction. After each scan, the stage moves back to the 
beginning of the next strip. 

In the *dead-time' associated, with the mechanical 'fly- 
back', the stage stops at a small number of places to 
focus (Boddeke et al 1994) . These samples are used 
to stay in focus during the subsequent scan. A linear 
function is fit to the focusing samples. Figure 3 shows the 
result of a fit using three focusing samples. The specimen 
contained DAPI counter stained interphase cell nuclei with 
a centromeric 8 probe labeled with HTC (provided by 
the Department of Cytometry and Cytochemistry, Sylvius 
Laboratory, Leiden University). The length of the strip 
is 3.2 mm. The linear fit z = 8.64 - 2 31x defines the 
focus position during the next scan. The estimated focus 
position is compared with the measured focus position. The 
maximum error is 1.1 mm whereas the average absolute 
error is 0.4 mm. The depth-of- focus of the objective 
(Nikon 20 x /0.75) is 0.36 mm (Longjiurst 1967). The 
average error is slightly larger then the depth-of-focus. 
Experiments have shown that it does not effect the result 
of spot counting in interphase nuclei (Nettea et at 1994), 
but other applications may require a smaller error and have 
to use more focusing samples. 

One scan involves five steps: (1) The stage accelerates 
to die required speed. (2) The camera opens the shutter 
and starts shifting the parallel register. (3) The continuous 
data stream is stored in camera memory. The data can be 
processed during the scan. The first field of data has to be 
removed as the pixels of the first field do not shift through 
the whole CCD element (4) Disable the camera trigger to 
stop fiie parallel shift at the end of the strip. One image 
is now acquired. (5) The stage moves beck to the starting 
point of the next strip and collects focusing data. These 
five steps are repeated until the total area is scanned. 

For example, to scan an area of 5 x 10 mm with the 
Kodak chip the system has to acquire a number iV 0 of scans 
each of 10 mm length using the following system setup: 
integration time T\ = 3 s 
objective Nikon 10 x /0.5 

overall magnification M = 25 
pixel size D = 6.8 (im 

serial dimension S = 1317 
parallel dimension P « 1035. 

The scanning parameters, using equations (1), (2) and 
(5), are then given by: 

spatial sampling frequency f 0 = 3.68 ^im" 1 

parallel shift frequency / p = 345 Hz 

stage velocity v a « 93.8 pm s" 1 

scanning speed vrm » 33 3 x HT3 mm 2 s" 1 

number of scans JV C = (5 mm) xf z /S = 14. 
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Integration time 7t(s) 

Eligmra 4. Hie speed increment of TOI scanning compared to 
static imaging for the KAF14C0 chip. The maximum speedup of 
2 is achieved when the integration time is equal to the readout 
time T r . 

Each scan takes 110 s, not including the focus time. 
The acceleration time is 0.1 s per strip, the readout time of 
the first field is 3 s and moving the stage back takes about 
0.5 s per strip. Hie total scan time is 1540 s in which 680 
Mpixels of data are acquired at an effective rate of 442 
kHz. Of the 1540 s only 14 x (3 + 0.5) = 19 s or 33 % 
of the total time is spent on initialization and fly-back. 

8. P(MammiBO 

To evaluate the performance of TOI scanning, we compare 
TDI scanning with normal static scanning. The same 
system is used for both scanning modes, the Photometries 
KAF1400 camera, lb compare the static to the dynamic 
approach we examine the improvement in speed and the 
image quality. The imaging quality is measured in terms 
of the signal-to-noise ratio (SNR) and spatial frequency 
response. 

One reason to use TDI scanning instead of a start-stop 
scanning is the speed increment. The speed-up depends on 
the integration time and the readout time of the camera. 
The readout time is defined as the time to shift one full 
field out of the CCD into memory at full rate. Considering 
(4), speed-up (0 is given by: 

Ti + T t + 5 Ti>T t 

max<Zi ( r r ) ll + i 7 t >Ti K) 



The numerator defines Che time to grab one image with a 
static system, assuming mat the stage moves to the next 
field during the readout time. The denominator gives 
the time to collect the data of one field using TDI. The 
initialization and fly-back times are ignored. Due to the 
maximum readout rate of the camera, the scanning time 
per field is limited by the readout time. Figure 4 shows the 
speedup using the KAF1400 chip. When the integration 
time is equal to the readout time, TDI scanning gives a 
maximum speedup of a factor 2. Equation (6) shows that 
the readout time determines the speed increment for a given 
integration time. The readout time is equal to the number 
of pixels divided by the fixed readout rate of 500 kHz for 
the Photometries 200 series. The consequence of (6) is 
that one should select a CCD element (number of rows 
and columns) that has a readout time that is comparable to 
the required integration time. TDI scanning then gives the 
maximum speed increment 

We compared the spatial frequency response of TDI 
scanning to the response of a static imaging system. The 
spatial frequency response (SFR) can be estimated by 
imaging a step edge from which we can derive the overall 
frequency response of the combined optical system and 
imaging system (MialiiMn et al 1994). We used the same 
camera for static imaging and TDI scanning. Static imaging 
yields a slightly better spatial frequency response than TDI 
scanning. The reduction of spatial frequencies has several 
causes. The continuous motion of the stage versus the 
discrete shift of the camera causes one-pixel blur in the scan 
direction of the resulting image. This would be the ideal 
case when mere is a perfect synchronization between stage 
and camera. A difference in speed will cause additional 
blurring of the image. Due to the stage motion, vibration of 
the specimen will smooth the image. Finally if the motion 
of the stage is not exactly aligned with the CCD shift 
direction, the image will be blurred perpendicular to the 
scan direction, lb limit the smoothing to half a pixel, the 
angle between the parallel shift and stage motion must be 
smaller then 03/ P rad, where P is the parallel dimension 
of the CCD. 

Experiments have shown that the degradation of the 
frequency response perpendicular to the scan direction is 
not significant The alignment of the system is very 
easy to accomplish thanks to the rotation head between 
the microscope and the camera. Figure 5 shows the 
overall frequency response in the scan direction of TDI 
scanning and static imaging. TDI scanning causes a small 
reduction in spatial frequency response. At a frequency 
of II cycle/mm mere its 10 % reduction in resolution; this 
is hardly visible. The degradation is comparable with 2 
pixels blur. If we multiply the spatial frequency response 
of static imaging with the Fourier transform of a two- pixel 
wide uniform filter the result is comparable to the spatial 
frequency response of TDI scanning. 
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figure 5. Spatial frequency response in the scan direction for 
static imaging and TDI scanning. A step edge is imaged using 
the KAF1400 chip ami a Nikon 20 x /0.75 objective. The 
cut-off frequency of the optical system is 2.7 cycles/mm. 
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Figure 6. The image SNR of TDI and static imaging for the 
whole dynamic range of light intensities. 



S3. Signal-to-noise ratio 

Considering the SNR we distinguish two aspects. First the 
variation between two or more independent images (pixel 
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Figure 7. The pixel SNR of TDI and static imaging for the 
whole dynamic range of light intensities. 

SNR) (Mullikin et al 1994) and secondly the variation 
between pixels within a single image (image SNR). The 
variation between two images with the same illumination 
is caused by three different sources: readout noise, dark 
current noise and photon shot noise. This method yields 
the SNR of an individual pixel illuminated by a stationary 
light source (pixel SNR). The image SNR is caused by the 
above listed noise sources in addition to the pixel variation. 
The pixel variation is caused by a different response of die 
individual CCD wells to the same amount of light The 
SNR is defined as 



SNR = 20 log (£) (dB) 



(7) 



where fi is the average intensity and a is the deviation. 
The variation between two images (average pixel variance) 
is defined as 

a, 2 = £ V ar(/,-/ 2 ) (8) 

where I\ and h are independent uniformly iUuminated 
images with the same average intensity ji. The standard 
deviation between pixels (image variance) is defined as 



of = var(/) 



where / is a uniformly-illnminated image. 

Two uniformly iUuminated images were acquired tor 
both TDI and static imaging for a range of intensities. 
The variations defined in (8) and (9) and the corresponding 
signal-to-noise ratios were calculated. Figure 6 and figure 
7 show the results using the KAF1400 chip. The thick gray 
line is the ideal SNR of a photon limited camera (a camera 
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Figure 8. A TDI image of DAP! counter stained cell nuclei. The image size is 360 x 3600 pixels, that is conxsponcBng to an 
area of 0.154 x 1.54 mm 1 on the slide. We have used the TH7882 chip and the Nikon 60 x /1.4 objective. 





Figure 9. An example of a TDI image (229 x 425) (a) and a static image (229 x 425) (b) of the same 
microscope field. The images are captured with a Nikon 60 x /1.4 objective and a integration time of 1.2 s. 



in which all other noise sources are negligible compared 
to the photon shot noise induced by the quantum nature of 
light) and therefore the upper bound for the measured SNR. 

In figure 7 we see that the pixel SNR of static and TDI 
scanning are comparable to the ideal SNR of a the photon 
limited camera. Other noise sources than photon shot noise 
are not significant If there is no variation between the 
pixels (electron wells) we would expect the same result in 
figure 6 for the image SNR. However, this is not the case. 
The image SNR is much lower for a static system. Using 
TDI scanning one pixel in the output image is an average 



over a whole column of electron wells. Therefor the 
variation is much less and is mainly deterrnined by photon 
shot noise. It is possible to correct the pixel variation 
for static imaging using flat field correction. Flat field 
correction requires a dark field image (shutter closed) and a 
blank flied image (illuminated image without objects) and 
must be computed using floating point operations. Therefor 
it is a time consuming operation. If the correction is 
properly done the image SNR of static imaging will be 
comparable to TDI imaging. 
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We have developed a tiirce-dekyed-integration (TDI) CCD 
scanner suitable for ftuorescence micmoscopy. TOE scanning 
results in a high data throughput without compromising 
the image quality. Time delayed integration is achieved 
by a Photometries slow scan CCD camera. This camera 
is available with several different CCD chips. We have 
evaluated the scanner with two different chips, KAF 1400 
and T51 7882. Figure 8 shows an example of scanning one 
strip of a slide using the TO 7882 chip. 

The scanning speed of TDI scanning is at most twice 
that of static scanning. Hie required integration time and 
the readout time of the CCD element determine the speed* 
up of TDI scanning. 

The spatial frequency response (SFR) of TDI scanning 
is compared with the SFR of a static imaging system. Due 
to the discrete pixel shift versus continuous motion and 
synchronization errors there is a small degradation of the 
spatial frequency response. Hie resulting blur in the image 
is comparable with a smoothing filter of (2 x 1) pixels and 
is hardly visible. 

TDI scanning provides a complete suppression of pixel 
variability. The image SNR of TDI scanning is more then 
10 dB better than the image SNR of static imaging. Figure 
9 shows the results of static and TDI imaging of the same 
microscope field. Visually there is hardly any difference. 

Besides the improved SNR, TDI scanning has the 
advantage that there is shading in only one direction 
(perpendicular to die scan direction). Another advantage 
is that the number of image edges is less {than with static 
imaging. Hie data throughput is therefore higher because 
fewer objects touch the image border and no overlap in the 
scan direction is necessary. 
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and Imagenetics (Naperville, Illinois, USA). 
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